Path Planning for Multi-Arm Manipulators Using Soft Actor-Critic Algorithm with Position Prediction of Moving Obstacles via LSTM
نویسندگان
چکیده
This paper presents a deep reinforcement learning-based path planning algorithm for the multi-arm robot manipulator when there are both fixed and moving obstacles in workspace. Considering problem properties such as high dimensionality continuous action, proposed employs SAC (soft actor-critic). Moreover, order to predict explicitly future position of obstacle, LSTM (long short-term memory) is used. The SAC-based developed using LSTM. In show performance algorithm, simulation results GAZEBO experimental real manipulators presented. experiment that success ratio generation arbitrary starting goal points converges 100%. It also confirmed successfully predicts obstacle.
منابع مشابه
Centralized Path Planning for Multi-aircraft in the Presence of Static and Moving Obstacles
This article proposes a new approach for centralized path planning of multiple aircraft in presence of the obstacle-laden environment under low flying rules. The problem considers as a unified nonlinear constraint optimization problem. The minimum time and control investigate as the cost functions and the maximum velocity and power consider as the constraints. The pseudospectral method applies ...
متن کاملAn Actor-Critic Algorithm for Sequence Prediction
We present an approach to training neural networks to generate sequences using actor-critic methods from reinforcement learning (RL). Current log-likelihood training methods are limited by the discrepancy between their training and testing modes, as models must generate tokens conditioned on their previous guesses rather than the ground-truth tokens. We address this problem by introducing a cri...
متن کاملEfficient Actor-Critic Algorithm with Hierarchical Model Learning and Planning
To improve the convergence rate and the sample efficiency, two efficient learning methods AC-HMLP and RAC-HMLP (AC-HMLP with ℓ2-regularization) are proposed by combining actor-critic algorithm with hierarchical model learning and planning. The hierarchical models consisting of the local and the global models, which are learned at the same time during learning of the value function and the polic...
متن کاملLocal Path Planning with Proximity Sensing for Robot Arm Manipulators
In this paper, the problem of sensor-based path planning for robot arm manipulators operating among unknown obstacles of arbitrary shape is considered. It has been known that, in principle, algorithms with proven convergence can be designed for planar and simple three-dimensional robot arms operating under such conditions. However, implementation of such algorithms presents a variety of problem...
متن کاملPath planning among moving obstacles using spatial indexing
A method is presented for planning a pa th in t h e presence of moving obstacles. Given a se t of polygonal moving obstacles, we focus on generating a pa th for a mobile robot t h a t navigates in t h e two-dimensional plane. O u r methodology is t o include t ime as one of t h e dimensions of t h e model world. T h i s allows u s t o regard the moving obstacles as being s ta t ionary in t h e ...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Applied sciences
سال: 2022
ISSN: ['2076-3417']
DOI: https://doi.org/10.3390/app12199837